Extending the Wizard of Oz Methodologie for Multimodal Language-enabled Systems
نویسندگان
چکیده
In this paper we present a proposal for extending the standard Wizard of Oz experimental methodology to language-enabled multimodal systems. We first discuss how Wizard of Oz experiments involving multimodal systems differ from those involving voice-only systems. We then go on to discuss the Extended Wizard of Oz methodology and the Wizard of Oz testing environment and protocol that we have developed. We then describe an example of applying this methodology to Archivus, a multimodal system for multimedia meeting retrieval and browsing. We focus in particular on the tools that the wizards would need to successfully and efficiently perform their tasks in a multimodal context. We conclude with some general comments about which questions need to be addressed when developing and using the Wizard of Oz methodology for testing multimodal systems.
منابع مشابه
Applying the Wizard of Oz Technique to the Study of Multimodal Systems
The Wizard of Oz (WOz) technique is an experimental evaluation mechanism. It allows the observation of a user operating an apparently fully functioning system whose missing services are supplemented by a hidden wizard. From our analysis of existing WOz systems, we observe that this technique has primarily been used to study natural language interfaces. With recent advances in interactive media,...
متن کاملRequirements for Multimodal Wizard of Oz Platforms
The Wizard of Oz (WOz) technique is a mechanism for the experimental evaluation of user interfaces. It allows the observation of a user operating an apparently fully functioning system whose missing services are supplemented by a hidden wizard. From our analysis of existing WOz systems, we observe that this technique has primarily been used to study natural language interfaces. With recent adva...
متن کاملA realistic wizard of oz simulation of a multimodal spoken language system
This paper describes a Wizard of Oz (WOZ) system that allows the realistic simulation of a multimodal spoken language system. A Wizard protocol has been drawn up which means that the WOZ system will simulate the limitations of an automatic system rather than allow the user to engage in the full range of human-human dialogue. In support of this protocol is a sophisticated Wizard response panel a...
متن کاملWizard of Oz Prototyping: When and How?
Progress in speech and language processing and multimodal systems technologies has led to the fact that prototyping with the Wizard of Oz (WOZ) system simulation technique is increasingly being used in systems design. When prototyping with WOZ, one or more 'wizards' simulate part or whole of the performance of the system being designed, while interacting with users who preferably believe themse...
متن کاملWizard of Oz experiments for companions
Wizard of Oz experiments allow designers and developers to see the reactions of people as they interact with to-bedeveloped technologies. At the Centre for Interaction Design at Edinburgh Napier University we are developing a Wizard of Oz system to inform and further the design and development of Companion based technologies. Companions are intelligent, persistent, personalised, multimodal, nat...
متن کامل